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Abstract — We investigate the network stability problem when 
two users are scheduled simultaneously. The key idea is to simul- 
taneously transmit to more than one users experiencing different 
channel conditions by employing hierarchical modulation. For 
two-user scheduling problem, we develop a throughput-optimal 
algorithm which can stabilize the network whenever this is 
possible. In addition, we analytically prove that the proposed 
algorithm achieves larger achievable rate region compared to 
the conventional Max- Weight algorithm which employs uniform 
modulation and transmits a single user. We demonstrate the 
efficacy of the algorithm on a realistic simulation environment 
using the parameters of High Data Rate protocol in a Code 
Division Multiple Access system. Simulation results show that 
with the proposed algorithm, the network can carry higher user 
traffic with lower delays. 

Index Terms — Max-Weight scheduling, hierarchical modula- 
tion, power allocation, queue stability, stochastic control. 

I. Introduction 

THE scheduling is an essential problem for any shared 
resource. The problem becomes more challenging in a 
dynamic setting such as wireless networks where the channel 
capacity is time varying due to multiple superimposed random 
effects such as mobility and multipath fading. In a queueing 
system, the most important property of a scheduling algorithm 
is to keep the network stable (e.g., the queue sizes remain 
bounded over time). The seminal work by Tassiulas and 
Ephremides has shown that Max-Weight algorithm scheduling 
the user with the highest queue backlog and transmission rate 
product at every time slot can stabilize the network whenever 
this is possible Q). 

It is well-known that Max- Weight algorithm is throughput- 
optimal, i.e., it stabilizes the network for all arrival rate 
vectors that are strictly within the achievable rate region. The 
performance of Max- Weight algorithm has been investigated 
in depth for the single user scheduling case. However, deter- 
mining a throughput-optimal algorithm when more than one 
users are scheduled simultaneously has not received much 
attention. In this paper, we propose a modulation-assisted 
throughput optimal scheduling algorithm scheme where we 
employ hierarchical modulation (HM). 

The authors in are the first to show the advantage of 
HM in broadcast systems. In 0, the authors proposed a multi- 
user scheduling algorithm and showed that HM offers lower 
queueing delay at the transmission buffer. However, in neither 
of these works, the authors considered the stability of the 
network. Network utility maximization problem with HM was 
investigated in |4|. Meanwhile, proposed scheduling and 
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flow control algorithms but did not take into account the effect 
of modulation on the performance of the algorithm. 

Our contribution can summarized as follows: i) we pro- 
pose a throughput optimal algorithm, namely Max-Weight 
with Hierarchical Modulation (MWHM) when two users are 
scheduled simultaneously;^) we give the conditions under HM 
that should be employed by considering both analytical and 
implementation issues. Hi) we prove that the proposed algo- 
rithm achieves larger rate region compared to the conventional 
Max-Weight algorithm; iv) we develop a lower complexity 
version of MWHM algorithm; v) we demonstrate via realistic 
simulations that our algorithm not only keeps the network 
stable with higher arrival rate but also reduces the average 
delay. 

II. System Model 

We consider a cellular system with a single base station 
(BS) transmitting to N users. Let Af denote the set of users in 
the cell. Time is slotted, t G {0, 1,2,.. .}. Let T s denote the 
length of the time slot in seconds. Let h n (t) represent channel 
gain of user n at time t, n € {1, 2, . . . , N}. The gain of the 
channel is constant over the duration of a time slot but varies 
between slots. 

HM is one of the techniques for multiplexing and modulat- 
ing multiple data streams into one single symbol stream, where 
those multiple symbols are superimposed together before 
transmission. In this paper, for the sake of ease of exposition 
we assume that only two layers of hierarchical modulation 
is used to serve two users simultaneously. Specifically, we 
assume that QPSK/16-QAM HM is implemented. Let BS 
transmit to two users, i.e., user n and user m, at time slot t by 
employing two layers of HM. Assume that user j has a better 
channel than user i , i.e., h n < h m . Then, user n is assigned 
to QPSK constellation which we refer to as base layer. User 
m is assigned to 16-QAM constellation which we refer to 
as incremental layer. More information about hierarchical 
modulation can be found in [3| and references there in. Since 
two modulated signals are mixed before being transmitted, 
they interfere with each other at the receiver side. However, 
in (§], the authors propose a decoding technique to cancel the 
interference seen at the incremental layer. Specifically, when 
mixed signal reaches to the receivers, the data at the base 
layer is first decoded and removed. Hence, the data at the 
incremental layer does not suffer from the transmission at the 
base layer. In [61, the achievable rates for user n and user m 
are given respectively as follows: 

,4(0 = T, x BW x log (l + M ' ) - P "" W ) . (2) 
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where P n ,b(t) and P m ,i(t) are the transmission powers for 
user n and m at the base and incremental layers, respectively. 
a is the noise power and BW is the bandwidth of the channel. 
We assume that the BS transmits at fixed power and the total 
power consumption is equal to P, i.e., P n .b(t) + Pm.i{t) = 
P Vt. /ifj(t) is upper-bounded such that < Umax ^> 

k £ {b,i}. Note that when UM is applied at the physical layer, 
full power is assigned to a single user and the amount of data 
that can be transmitted in that case is given by, 

K{t)P 



Hl m (t) = T s x BW x log 1 



(3) 



where n € {1,2, ... ,N}. Let a n {t) be the amount of data 
(bits or packets) arriving into the queue of user n at time slot 
t and a n (t) < a max Vi, and assume that a n (t) is a time and 
user independent stationary process. We denote the arrival rate 
vector as A = (Ai, A2, ■ ■ • , Xn), where A„ = E[a n (i)]. Let 
q(t) = (qi(t), Q2(t), ■ ■ ■ ,qiy(t)) denote the vector of queue 
sizes, where q n (t) is the queue length of user n at time slot 
t. The dynamics of the queue of user n is given as, 

q n (t + 1) = [q n (t) + a n (t) - p*(t)]+ . (4) 

where (x) + = m&x(x, 0) and k £ {b, i}. Let A denote the 
achievable rate region (or rate region) defined as the closure 
of the set of all arrival rate vectors for which there exists an 
appropriate scheduling policy stabilizing the network. 

III. Throughput Optimal scheduling 

In this section, we give a throughput optimal scheduling 
algorithm when HM is employed. However, we start with 
the conventional Max- Weight algorithm employing UM to 
schedule a single user at every time slot. 
Max-Weight with UM (MWUM): At time t, given h n (t) and 
q n (t) for all n £ Af, schedule user n* which has the maximum 
queue length and service rate product, i.e., (TJ: 



C(*)=9»(0C(*) 

n* = argmax W™ m (t). 



(5) 
(6) 



We define W u (t) = wlffP'{t). Let A u denote the rate region 
achieved by MWUM. 

Max- Weight with HM (MWHM): At time t, given h n {t) 
and q„{t) for all n £ Af schedule two users (n*,m*) such 
that h n * (t) < h m * (t) to maximize the sum of queue length 
and service rate products, i.e.,: 



«C(t) = ff«(*K (*) + 3m(*K, (<) 



(n*,m*)= argmax w^n{t)- 

(n ,m) \n^m 
h n (t)<h m (t) 



(7) 
(8) 



We define W h {t) = 



,hm 



* (t). Let Ah denote the rate region 



achieved by MWHM. 

Since BS has limited power budget, power allocation must 
be performed to determine ^ h n (t) and n l m (t). 

Power Allocation with HM: Recall that Max- Weight type 
scheduling algorithms aim to maximize the weight w^™ n (t) 
(or w^ m (t)) at each time slot. It is easy to determine the 
maximum weight achieved by UM, w™ l (t). However, the 



maximum weight under HM depends on power allocations 
P* b (t) and Pmi{t)- Without loss of generality, for a given 
pair of users, e.g., user n and user m such that h n (t) < h m (t), 
the optimal power allocation maximizing the weight w^ r ^ l (t) 
is obtained by solving the following optimization problem: 



max q n (t)n n (t) 

Pn,b(t),Pm,i(t) 



■«™W/4(t) 



s.t. P n<b (t) + P mti (t) = P 



(9) 
(10) 



Note that P* b (t) and P* t ^t) both have a non-zero value when 
(I9l-(fl0li is a convex problem. Now, we give a Lemma which 
states the necessary conditions for this to hold. For notational 
convenience, we drop the time index. Let us define, 



{h n p mti + o-y 



and B 



h 2 



( & m. Pn 



where < P m ,i(t) < P. 

Lemma 1: The problem (l9l)-(flOT) is a convex optimization 
problem when the following inequality is satisfied 



q n A< q m B 



(11) 



Proof: We show that the objective function in (0 is 
concave under the given condition. The objective function 
can be rewritten by noting that P n 5 = P — P m; i. Since the 
parameters T s and BW do not effect the concavity, we have 
the following objective function, 



/ = g w log(l+ y^ ^ Vftnlogfl / '"' / ' 



m.i 



Taking the second derivative of / with respect to P m + yields, 

d 2 f 



dP, 



2 

m.i 



q n A - q m B. 



(12) 



d 2 f 

For concavity, dp .j must be less than or equal zero, i.e., 

■££- < 0. Thus, q n A < q m B. M 

As long as the condition in Lemma 2 is satisfied, the optimal 
power allocation can be found by taking the first derivative of 
/ and setting it to zero. The first derivative of / with respect 
to P m ,i is given by, 



df 
dP m . 



= -q„VA + q m vB = 0. 



Thus, we have, 



hnhmi^qn qm) 

p* p p* 

n.b m.i' 



(13) 



(14) 
(15) 



Lemma 2: If A £ A h (i.e., A is feasible), then MWHM 
algorithm stabilizes the network and it is throughput optimal. 
Proof: The proof is given in Appendix [A] ■ 
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IV. Max-Weight Algorithm with Dynamic 
Modulation (MWDM) 

Note that MWHM can only be used when there is an inner 
point solution to the problem ((9J - ([TOj , i.e., < P^ li < P. If 
the solution is on the boundary, i.e., P* n i = or P* n i = P, 
then full power is assigned to a single user and HM is no 
longer employed, i.e., transmission to a single user is optimal. 

Now, we propose Max-Weight algorithm with dynamic 
modulation (MWDM) that dynamically decides which mod- 
ulation (HM or UM) must be employed at every time slot. 
Let Wd(t) and A d be the maximum weight at time t and 
the rate region achieved by MWDM, respectively. MWDM is 
implemented as follows: 

• Step 1: The scheduler applies MWUM and finds the 
maximum weight W u (t) by using (f5]l and ([§}. 

• Step 2: The scheduler applies MWHM as follows: For 
every pair of users (n, m), find u^^i): 

- if h n < h m , then user n is embedded at the base 
layer whereas user m is the incremental layer or vice 
versa. 

- Check whether the condition in Lemma 2 is satisfied. 

- If not, w£™ (t) = max{< m ,< m } and UM is 
employed. 

- Otherwise, determine the optimal power allocation 
P^ j and P* b according to ([T4l and ([Hl l. respec- 
tively. 

- Then determine w^^it) according to (£7). 

• Step 3: After finding w'^"^ for all pairs, determine Wh(t). 
. Step 4: If W h {t) > W u (t), then W d (t) = W h (t) and 

HM is employed. Otherwise, W d {t) = W u (t) and UM is 
employed. 

Let us define the expected weights achieved by MWDM 
and MWUM as E[W d (t)] and E[W u (t)}, respectively. 

Theorem 3: The achievable rate region of MWUM algo- 
rithm is a subset of the achievable rate region of MWDM, 
i.e., A u C A d . 

Proof: We use the theorem given in [7| to prove the 
lemma. According to the theorem, if E[Wd(£) > E[W„(i)], 
then MWDM can at least achieve the rate region of MWUM. 
The average weight achieved by MWDM is always greater 
than or equal to the weight achieved by MWUM since MWDM 
can either apply HM or UM according the maximum weight. 
Thus, the following inequality holds at every time slot, 

W d (t) > W u (t) (16) 

Taking the expectation of both sides of ( TTBT l yields that 

nw d (t)} > e[w„(*)]. " ■ 

Hence, MWDM can be used to increase the total network 
throughput. 

A. A low complexity algorithm 

Note that the implementation of MWDM algorithm requires 
the calculation of the optimal power allocation and the weight 
of every pair of users. This requires a computational complex- 
ity of 0(N 2 ). Now, we propose a low complexity algorithm 
(L-MWDM) that has a computational complexity of O(N). 

L-MWDM algorithm is implemented as follows: 



• Step 1 : Determine user n* according to (0 and © which 
is the optimal user selected under UM. Determine W u (t) 
by using ©. 

• Step 2: For every user m ^ n*, m £ AT do: 

- if h n * < h m , then user n* is embedded at the base 
layer whereas user m is embedded at the incremental 
layer or vice versa. 

- Check the condition in Lemma 2 is satisfied. 

- If it is not, w%? m (t) = max{w™,< m } and UM 
is employed. 

- Otherwise, determine the optimal power allocation 
P*„ b and P^ i according to (fl4l) and dl3T >. respec- 
tively. Then, determine w^P m (t) according to (jTj. 

• Step 3: After finding w„™ m (t) for every user m ^ n* 
determine Wh(t). 

. Step 4: If W h {t) > W u (t), then W d (t) = W h (t) and 
HM is employed. Otherwise, W d (t) = W u (t) and UM is 
employed. 

Note that the difference between MWDM and L-MWDM is 
that MWDM checks the weights achieved by every pair of 
users. Hence, its complexity increases quadratically with the 
number of users. On the other hand, L-MWDM calculates the 
weights assuming that user n* is always scheduled. Thus, its 
complexity is linear with N . However, the maximum weight 
obtained with MWDM is always greater or equal to that of 
L-MWDM. 

V. Simulation Results 

In our simulations, we model a single cell downlink trans- 
mission utilizing high data rate (HDR) J8). The base station 
serves 20 users and keeps a separate queue for each user. 
Time is slotted with length T s = 1.67 ms as defined in HDR 
specifications. We set BW = 1.25 MHz, P = 10 Watts 
and a = 10~ 6 Watts. Packets arrive at each slot according 
to Bernoulli distribution. The size of a packet is set to 128 
bytes which corresponds to the size of an HDR packet. The 
wireless channel between the BS and each user is modeled as 
a correlated Rayleigh fading according to Jakes' model with 
different Doppler frequencies varying randomly between 5 Hz 
and 15 Hz. 

Figure Q] depicts the maximum arrival rate that can be 
supported by MWDM, L-MWDM and MWUM. Clearly, as 
the overall arrival rate exceeds 30 packets/slot queue sizes 
suddenly increase with MWUM and the network becomes 
unstable. However, MWDM and L-MWDM improves over 
MWUM by supporting the overall arrival rate of up to 32 
packets/slot. Therefore, MWDM can achieve a larger rate 
region than MWUM as verified analytically in Theorem [3] 
Figure Q] also shows the sum of the queue lengths vs. mean 
of overall arrival rate (packets/slot), i.e., the increase is about 
1.2 Mbps. As the average arrival rate increases the average 
queue backlogs increase as well in all algorithms. Following 
Littles' Law, larger queue backlogs yield longer network 
delays. However, due to the possibility of serving more than 
one queue at a time, MWDM and L-MWDM outperform 
MWUM in terms of the average delay. This result indicates 
that MWDM and L-MWDM are better techniques for delay 
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Fig. 1. Average total queue sizes vs. overall mean arrival rate. Fig. 2. Average total queue sizes vs. transmit power, P 



sensitive applications. In addition, the delay performance of 
MWDM and L-MWDM are very close. Recall that L-MWDM 
always schedules user n* which is the optimal user in MWUM 
algorithm. Similar to L-MWDM, MWDM schedules user n* 
most of the time. Figure [2] shows the sum of the queue 
lengths vs. transmit power, P in Watts when the overall mean 
arrival rate is 28 packets/slot. Clearly, as P increases, the 
average queue size with both MWDM and MWUM decreases 
as well. However, the steady state queue length is achieved 
with MWUM at P = 4 whereas MWDM reaches to the steady 
state at P = 3. As a conclusion, HM based scheduling requires 
less power than the uniform constellation based scheduling to 
stabilize the network. 

VI. Conclusions 

In this paper, we investigate the advantages of transmissions 
of more than one data streams simultaneously in a network 
stability problem. We propose to use hierarchical modulation 
with Max- Weight algorithm when two user are scheduled 
simultaneously. First, we give the optimal power allocation 
among users. Then, we show that the proposed algorithm can 
support higher user traffic compared to the conventional Max- 
Weight Algorithm. In addition, we demonstrate that with the 
proposed algorithm the average delay reduces dramatically. 
HM is a good technique for scheduling problem especially 
when the number of users in the system is large and BS 
transmits high transmission powers. 

Appendix A 
Proof of Lemma|2] 

We can write the following inequality by using the fact 

([a] + ) 2 < (a) 2 , Va: 

ql(t + 1) <q 2 n (t) + (Li max ) 2 + (a max ) 2 

- 2q n (t)\p n (t) - a n (t)] (17) 

Define the following Lyapunov function and conditional Lya- 
punov drift: 

N 

£(q(*)) = E < 18 > 

n=l 

A(i)^E[L(q(* + l))-L(q(i))|q(i)]. (19) 



By using ( TP71 ) and ( fT8l , one can show that the Lyapunov drift 
of the system satisfies the following inequality at every time 
slot, 

A(t) < B-J2 E tin(t)Hn(t)\q(t)}-Y,qn(t)\ n (20) 

n n 

where B = |((fi mal ) 2 + (a max ) 2 ). Note that the second term 
in the right hand side of ( f20b can be rewritten as follows when 
two users are scheduled: 

£]E{?n(*)A*»(*)|q(*)}= £ E{ qi (t)^(t)+ q] (t)^(t)\q(t)} 

hi<hj 

Now, it is easy to see that MWHM minimizes the right 
hand side of (|20| > at every time slot. Therefore, according 
to Lyapunov-Foster criteria, q(t) process is positive recurrent 
Markov chain and MWHM can stabilize the network whenever 
this is possible ||9l . 
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